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Abstract. We consider excited random walks with M "cookies" where the i-th cookie at each 
site has strength p;. There are certain natural monotonicity results that are known for the excited 
random walk under some partial orderings of the cookie environments. For instance the limiting 
speed limn-t-oo X n /n — v(pi,p2, . . . ,Pm) is increasing in each pj. We improve these monotonicity 
results to be strictly monotone under a partial ordering of cookie environments introduced by 
Holmes and Salisbury. While the self-interacting nature of the excited random walk makes a direct 
coupling proof difficult, we show that there is a very natural coupling of the associated branching 
process from which the monotonicity results follow. 



1. Introduction 

An excited random walk is an interacting random walk where the transition probabilities depend 
on the number of prior visits to the current site. In this paper we will be interested in the case of 
an excited random walk on Z with a deterministic "cookie environment" with finitely many cookies 
at each site. The model can be described in the following way. Let M be a positive integer, and 
let p = (pi,P2> ■ • ■ ,Pm) £ (0, 1) . Then, an excited random walk {X n } n >o may be defined by 
Pp(X = 0) = 1 and 

Pp\X n +i = X n + 1 1 F n ) = 1 — Pp(X n +i = X n — 1 1 Fn) 



Pj if < n : X k = X n } = j 
1/2 if #{k < n : X k = X n } > M. 



with T n = cr(Xk, k < n). 



The following "cookie" interpretation of excited random walks was originally given by Zerner 
|Zer05| . One imagines that there is a stack of M cookies at each site x G Z. Then, upon the j-th 
visit to x the random walker eats the j-th cookie at that site which "excites" the random walker 
and causes the next step to x + 1 with probability pj and to x — 1 with probability 1 — Pj- After 
M visits to x there will be no cookies left at the site and so upon all subsequent returns to x the 
random walker moves like a simple symmetric random walk. The sequence p = (pi,P2, ■ ■ -Pm) is 
therefore called the cookie environment for the excited random walk. 

Remark 1.1. In the most general model for excited random walks the cookie environment can 
be random, non-spatially homogeneous, and with infinitely many cookies per site |Zer05l IKZ08J . 
However, for the purposes of this paper we will consider only the simpler setup of deterministic 
cookie environments with finitely many cookies per site. 
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Excited random walks in the above setup have been studied extensively, and there is an explicit 
criterion for recurrence/transience as well as ballisticity that depends only on the total drift of 
cookies at each site: 

M 

5 = 5(p) = ^(2 Pj - 1). (1) 

3=1 

In particular, the following is known. 

Theorem 1.2 (Theorems 1 and 2 in |KZ08| ). Let X n be an excited random walk with cookie 
environment p = (pi,P2, ■ ■ ■ ,Pm) with P j € (0, 1) for all j = 1, 2, . . . M. 

(i) Pp , (lim„_> 00 X n = +oo) = 1 if and only if 5 > 1 

(ii) Pp-(lim ra _ !>00 X n = — oo) = 1 if and only if 5 < —1 

(hi) Pp-(lim inf n -)-oo X n = — oo, lim sup n ^. oc X n = oo) = 1 if and only if 5 € [—1, 1] 

(iv) There exists a deterministic constant v{p) such that 

lim — - = v(p), Ptf-a.s. 
n— >oa n 

Moreover, v{p) = if and only if 5 € [—2,2]. 

Our aim will be to study some natural monotonicity properties of some quantities defined in 
terms of the excited random walk. To this end, first consider the natural partial ordering of cookie 
environments given by 

p < q if Pi < Qi for all i = 1, 2, . . . M. (2) 
The following monotonicity results follow from slightly more general statements in |Zer05] . 

Theorem 1.3 (Theorem 16 in [Zer05j ^. If p < q, then P^{X n > 0, Mn > 0) < P${X n > 0, Mn > 0). 

Theorem 1.4 (Theorem 17 in |Zer05j ). If p < q, then v(p) < v(q). 

Remark 1.5. In [Zer05j . Zerner assumed that all cookies induced a positive drift. That is pj > 1/2 
for all j. However, the proofs of Theorems 11.31 and 11.41 do not use this assumption. 

Recently, Holmes and Salisbury introduced a weaker partial ordering on cookie environments 
than ([21) which generalizes Zerner's monotonicity results above [HS12j . 

Definition 1. We will write p =4 qii there exists a coupling P of (Y, Z) with Y = (Y\, Y2, . . . , Ym) 
and Z = (Zi, Z2, ■ ■ ■ , Zm) are such that 

• {Yx, Y2, . . . , Ym} are independent Bernoulli random variables with Yj ~ Ber(pj). 

• {Zi, Z2, . . . , Zm} are independent Bernoulli random variables with Zj ~ Ber(q , j). 

• P (E7=i Yj < E7=i Zj) = 1 for every m = 1, 2, . . . M. 



Moreover, we will write p -< q if in the above coupling we have P ^EJ=i Yj < SJLi Zjj > f° r 
some m < M. 

Example 1.1. Suppose that p = (pi, P 2, ■ ■ ■ ,Pm) and pi < p^ for some i < k and let q = 
{qi,q2, • • • , qui) be such that 



Pi j = k 

Pj j<£{i,k}. 
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Then p -< q. It is enough to show that this is true when M = 2; that is (pi,P2) ~< (P2,Pi) if P2 > Pl- 
Indeed we can give the following explicit coupling. 



y 


z 


P(Y = y, Z = z) 


(0,0) 


(0,0) 


(1- P l)(l-P2) 


(0,1) 


(0,1) 


-P2) 


(1,0) 


(1,0) 


Pl(l -P2) 


(0,1) 


(1,0) 


P2 "Pl 


(1,1) 


(1,1) 


PlP2 



Remark 1.6. Note that p ^ q implies that < ^Ei=iO^ ~~ ^i)] = Sf=i 9* ~~ X^t=iP« f° r an 
= 1,2,... , M. In particular, p ^. q implies that <5(p) < S(q). However, as the above example 
shows, it is possible to have p -< q and 5(p) = 5{q). 

Our goal is to prove the following strict monotonicity results which strenthen some weak mono- 
tonicity results in |HS12j . 

Theorem 1.7. If p-< q and 5(p) > 1, then 

Pp(X n > 0, Vn > 0) < P ? (X n > 0, Vn > 0). 

Theorem 1.8. If p -< q then either v{p) = v(q) = or v{p) < v(q). 

Due to the self-interacting nature of excited random walks, the natural approach to proving 
Theorems 11.71 and 11.81 via a direct coupling of excited random walks fails. Many of the recent 
results for one-dimensional excited random walks use a branching processes with migration that is 
related to the excited random walk [BS071 lBS08l IKZ081 IKMlll IRR111 IDK121 IPetl2j . The main 
idea of the proofs of Theorems 11.71 and 11.81 is that the ordering =<! on cookie environments leads to 
a very natural coupling of the associated branching processes with migration. 

The remainder of this paper is structured as follows. A review of the associated (forward and 
backward) branching processes with migration is given in Section[2j Sections[3]and[3]then construct 
the couplings of the branching processes and show how they can be used to prove Theorems 11.71 
and 11.81 respectively. 



2. Forward and backward branching processes with migration 



In this section we recall two branching processes with migration and explain their relation to 
the excited random walks. We will use the "coin tossing" construction of the branching processes 
given in [KZ08j . For a fixed cookie environment p = (pi,P2, • • -Pm) let {dj}iez,j>i be a collection 
of independent Bernoulli random variables with 

{ Bernoulli (pj) j < M 
Bernoulli(l/2) j > M. 

The random variables £jj can be used to generate the path of the excited random walk. In par- 
ticular, on the j-th visit to the site i € Z the random walk will step right if & , = 1 and left 
otherwise. 

Next we use the same Bernoulli random variables £jj to construct the forward and backward 
branching processes associated with the excited random walk. 
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2.1. Forward branching process. For each fixed i € Z, we may think of the sequence {£i,j}j>i as 
representing a sequence of independent trials. We say that the j-th. trial is a success if £jj = 1 and 
a failure otherwise, and we define S^fc for to be the number of successes in the sequence {£ij}j>i 
before the fe-th failure. That is, 



S itk = min < 



m+k 

m > : £jj = m 



(Note that this definition makes sense for k = as well with S%o = 0.) Then the forward branching 
process -jVj}j>o is defined by 

Vq = 1, and Vf+i = SVt-l,^ for i > 0. (3) 

The relevance of the forward branching process to the excited random walk can be seen by 
looking at the right excursions of the excited random walk. Let T + = inf {n > 1 : X n = 0} be the 
first return time of the excited random walk to the origin. For every i > let Ui be the number of 
times the random walk steps from i to i + 1 before time T + . That is, 

Ui = #{n < T+ : X n = i, X n+l = i + 1}. 

Lemma 2.1. U <V, for all i > 0, with equality for all i > on i/ie event {X\ = 1, Tq^ < oo}. In 
particular, this implies that 

P f {X 1 = l,T+ = 2k) =P f (^Ui = k\ =p 1 pJY / V i = kV Vfc>l. (4) 

\i>0 / \i>0 / 

Proof. The first part of the lemma was proved in |KZ08l Section 4] and so we will only briefly 
explain the intuition. First note that Uq = 1 if and only if X\ = 1 and that Vq = 1 by definition. 
When Xi = 1 and T+ < oo then every jump to the right from i > 1 is matched by a jump to the 
left from i + 1. If U% = k then there are k jumps from i + 1 to i before Tq~ and the k-th such jump 
to the left corresponds to the k-th failure in the sequence i}j>i- Therefore, it is evident that 
the number of jumps to the right from i + 1 before T + is f/j+i = Si+i,fc and so C/j = implies 
C/j-fi = V^+i when Tq~ < oo. On the other hand, if X\ = 1 but Tq = oo then the last jump 
right at every i > 1 is not matched with a corresponding jump to the left from i + 1. Therefore, 
\{Ui = k then it may be that not all of the "successes" before the A>th "failure" in the sequence 
{£i+i,j}j>i are used to generate jumps to the right. Thus U + ± < Si + ± t k and so by induction we see 
that Ui < Vi on the event {T^ = oo}. 



To prove (ffl first note that 



2j> 



i>0 



on {X 1 = -1} 

T+ on {Zi = 1, T+ < oo} (5) 
oo on {Xi = 1, Tq 1 " = oo}. 

This proves the first equality in @. To prove the second equality in we claim that 

J2u i = k[ = \x 1 = l,J2Vi = k[. (6) 

i>0 J [ i>0 J 

Indeed, X^i>o U = k for some finite A; > 1 implies that Xi = 1 and Tq~ = 2/c < oo. Therefore, the 
first part of the lemma then implies that Ui = Vi for all z > and so X^i>o ^» = ^ as weu - O n t ne 
other hand, if Xi = 1 and X^i>o ^ ^ s fi n ite then Uq = 1 and it follows from the first part of the 
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lemma that ^2 i>0 U% is finite as well. By ([5]) this implies that T + is finite and so Yli>o U% = Sj>o ^ 
when X\ = 1 and X^>o < oo- Finally, the second equality in (j3|) then follows from © and the 
fact that the events {X\ = 1} and {^i>o ^ = ^} are independent since the first only depends on 
£o,i and the second only depends on {£ij}j>i j>i (recall that Vq = 1 by definition). □ 

Let ay = inf{i > 1 : Vi = 0} be the lifetime of the forward branching process V{. Since 
Si>o ^ < °° if and only if ay < oo, applying Lemma 12 . 1 1 implies the following corollary. 

Corollary 2.2. Pp<X n > 0, Vn > 0) = piP^oy = oo). 

Proof. Obviously, Pp{X n > 0, Vn > 0) = Pp{X\ = 1, Tq" = oo). Then, Lemma [2J] implies that 
Pp(X n > 0, Vn > 0) = P^Xx = 1) - P p -(Xi = 1, T+ < oo) 

= pi - ptPp V i < 00 = (XI ^ = 00 

\»>0 / \«>0 

The proof is concluded by noting that {^2 i>0 Vi = oo} = {ay = oo} since is an absorbing state 
for the Markov chain Vi . □ 

2.2. Backward Branching Process. The backward branching process that we will construct 
differs from the above constructed forward branching process in two ways. First, we will reverse the 
roll of "failures" and "successes." Secondly, there will be an extra immigrant before reproduction in 
each generation. To make this precises, let F^j- be the number of failures in the sequence {Ci,j}j>i 
before the fc-th success. That is, 



^ik = nun < 



m+k 

m > : £jj = k 



i=i 

(Note that the above definition gives P« o = 0.) The backward branching process {Zj}j>o is defined 
by 

Z = 0, and Z i+1 = F i+ x jZi +i for every i > 0. 

The relevance of the backward branching process to the excited random walk can be seen by 
examining the hitting times T n = m.i{k > : X^ = n}. For n > 1 and x < n let be the number 
of times the random walk jumps left from x to x — 1 before time T n . That is, 

D n x = # {k < T n : X k = x, X k+1 =x-l}. 

Lemma 2.3. Suppose that the excited random walk is either recurrent or transient to the right (that 
is 5{p) > —I). Then for any n > 1, the sequence (D™, • • • , D™, Dq) has the same distribution 

as (Zo, Z\, . . . , Z n -\,Z n ). 

Remark 2.4. This relation between the backward branching process and the excited random walk 
was first shown in |BS07] for deterministic cookie environments, but the general idea goes back at 
least to |KKS75j where it was used to analyze random walks in a random environment. It should 
also be noted that Lemma 12.31 also holds for excited random walks when the cookie environment is 
spatially i.i.d. |KZ08| . 



We will omit the proof of Lemma 12.31 since it is well known (see the above references) and the 
ideas are similar to the proof of Lemma 12.11 We remark that (in contrast to Lemma 12. ip it is not 
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true that the two sequences are identical, but only that they have the same distribution and that 
this follows from the fact that the sequence of Bernoulli trials at each site {£ij}«ez, j>i is i.i.d. in i. 

Lemma 12.31 can be used to relate (the distribution of) the backward branching process to the 
hitting times T n . However, the correspondence is slightly simpler if one instead considers the 
amount of time the random walk spends to the right of the origin prior to hitting n. That is, 

f n = #{k <T n : X k > 0}. 

Corollary 2.5. Suppose that the excited random walk is either recurrent or transient to the right 
(that is 5(p) > —1). Then, 

n-l 

T n l ^n + 2j2Zi + Z n (7) 

8=0 



Proof. First note that on the event {T n < co}, 

T n = n + 2^2D- (8) 

x<n 

Indeed the n counts the first step from x to x + 1 for each x = 0,1,... , n — 1, and every step from 
x to x — 1 before T n is matched with a later corresponding step from x — 1 to x. Similarly, by only 
counting the steps that begin at x > we obtain that 

n 
x=l 

The proof is the completed by applying Lemma [2 .31 and noting that the assumption that 5(p) > — 1 
implies that T n < co with probability one. □ 



3. Proof of Theorem 11.71 



In this section we will use the forward branching process V{ defined above to prove Theorem 11.71 

Proof of Theorem \1.7\ As noted in Remark II .6( p -< q implies that p\ < q\. Thus, by Corollary 12.21 
it is enough to prove that 

5(p) > 1 and p -< q P^{o~v = oo) < Pq{crv = co). (9) 

To this end, we will use the relation p -< q to give a coupling of the forward branching processes in 
the cookie environments p and q, respectively. In particular, let 

{(Yj, Zj)} ig z = {(0^,1, • • • , X^m)i ■ ■ ■ > Yi,M))}ieZ 

be an i.i.d. sequence of joint random variables with each (Yj, Zj) having the same joint distribution 
as (Y, Z) given in the definition of the partial ordering p < q. Also, let {Bj}j g ^ = {Bij}i £ z, j>i be 
an i.i.d. collection of Bernoulli(l/2) random variables that is independent of {(Yj, Zj)}j g z. Finally, 
we will construct E = {Ei} = {£i,j}iezj>i and 3' = {E'^} = {C'ij}i&,j>i by letting = (X i; Bj) 
and E[ = (Yj, B,,). That is, 

f^- ifj<M ^ {/.,, ifj<M 

[IK., y if j>M \ /,',., y if j>M. 

We will denote the joint distribution of (E, E') by Pp,q- Note that this coupling has the following 
properties. 



MONOTONICITY IN EXCITED RANDOM WALKS 



7 



• The marginal distributions of E and E' are Pp and Pg*, respectively. 

• {(Ej,E')}j g z is an i.i.d. sequence under Ppfi- 

• For any i G Z and m > 1, X^li < EjLi £ij> ^V,g-a.s. 

• There exists an m < M such that 



m 



% E«w<E«w >0 - ( 10 ) 

\i=i j'=i / 

With the above construction of E and E' we can now give a coupling of the forward branching 
processes in cookie environments p and q, respectively. Let, S^k and k be the number of successes 
before the k-th failure in the sequences of Bernoulli trials {S,i,j}j>i and {^,}j>i, respectively, and 
let 

V = Vq = 1, and V i+ i = S i+ i, Vi , V- +1 = S' l+xy ,. 
The above properties of the coupling (E, S') imply that S^k < S' ik for all i G Z and A; > 1. Since 

Vi<Vi => Vi+i = Si+iM < s i+1)Vi > < S i+l y, = V- +1 , 
it follows by induction that V{ <V( for all i > 0. 

Let ay = inf{i > 1 : V% = 0} and <7y = inf{z > 1 : V( = 0} be the lifetimes of the processes V% 
and V(, respectively. Then, since < V? it follows that oy < Oy, and so to prove @ it is enough 
to show 

Pp,q( a V < oo, a' v = oo) > 0. (11) 
To this end, note that for any k > 1, 

Pp^a v < oo, a' v = oo) > P^fc = F x < Vjf, V 2 = < V£ ^ = oo) 

> P^A = V l < V{, V 2 = 0< VfiP^av = oo) 

> Pp^Vx = k< V[, 5 2ifc = < S'^P^ay = oo) 

= PpiVx = k)Pp^S 2 , k = < S'^P^ay = oo), (12) 

where in the second inequality we use the Markov property and the fact that P^(oy = oo| Vo = m) 
is increasing in m (which can be easily seen from the construction of the process Vi). It was shown 
in [KZ08] that P^(ay = oo) > if and only if 5(q) > 1 (in |KZ08j this fact was then used to prove 



part (i) of Theorem 1 1 . 2f> . Since we assumed that S(q) > 8{p) > 1, using (fT2j) we will be able to 
conclude that (jlip holds if we can show that 

Pp,q( S W = < S 2k) > for some k > 1 - ( 13 ) 



To show (H3J), let 

{/ m m \ 

m > 1 : p va (E^i < XX j > 1 • 

Then it must be the case that Pp,q*(£i,j = £,[ j = 1, 2, . . . k — 1) = 1. In particular, this implies that 
= £E7=ite,;-^)] = Ef=i(Pi-%) for all m < k while > S^fer^)] = £ * =1 (Pi-?i)- 
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Thus, this choice of k implies that pj = qj for all j < k and Pk < Qk- Therefore, we have that 

(k k 
E^ = 0< E4 
j'=i i=i 

(fc-i 

(fc-i \ //c-i 

E^m- = °4* = 1 1 - p m (EX = °>&>* = 1 

= (i - qi) ■ ■ • (i - gfc-i)% - (i - pi) • • • (i - Pfc-i)pifc. (14) 

where in the second and third equalities above we are using that £y = ^ ^ for all j < k. Then since 
our choice of k implies that pj = qj for j < k and pk < qk, (|14p is strictly positive. This completes 
the proof of (Q3D and thus also the proof of Theorem 11.71 □ 

4. Proof of Theorem 11.81 

If 5(p) > 1, then the excited random walk is transient to the right. Therefore, the total time spent 
to the left of the origin is finite. In particular, the total number of jumps to the left from the origin 
= lira n _s.oo Dq is finite P^-a.s. Then, Lemma 12.31 implies that Z n converges in distribution 
as n — >• oo and we will let P2° denote this limiting distribution. As was noted in [BS07j . since 
the backward branching process is an irreducible Markov chain (as can be easily seen from the 
definition) which converges in distribution, it follows that Zi is positive recurrent and that P2° is 
the unique invariant measure for the Markov chain {Zj}j>o- 

Lemma 4.1. Suppose that 5{p) > 1. Then, 

1 



v (p) := lim X n /n 



l + 2Ef[Z Q \ 

Remark 4.2. We have not assumed that E°?[Zq] < oo, and in fact this is only true of 5{p) > 2. 
However, the formula above still holds even if 5(p) € (1,2] since the limiting speed is v(p) = in 
that case [BS071 IKZ08] . 

Proof. First, it is standard to show that if lmin^oo X n /n = v(p), then limn^oo T n /n = l/v(p). 
Moreover, since the random walk spends a finite amount of time to the left of the origin it follows 
that linxn^oo T n /n = l/v(p) as well. Secondly, note that the representation ([8]) implies that 

1 T 1 2 n V) n 1 n 

= lim — = 1 + lim - V Dl + = 1 + 2 lim - V D™, Ry-a.s., (15) 

v(v) n->oo n n->oo n n n->oo n 

X1 > x=l x=l 

where the second equality follows from the fact that limn^oo Dq < oo, i-^-a.s. Lemma 12.31 implies 
that 

n n 
x=l i=0 

and it follows from an ergodic theorem for positive recurrent, irreducible Markov chains that 

^ n— 1 

lim - V Zi = Ef [Z ] , P r a.s. (17) 

i=0 
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Combining fgft, (JTEJ and (H7J), we obtain that = 1 + 2P2°[Z ]. □ 

We are now ready to give the proof of Theorem 11.81 

Proof of Theorem \1.8[ Recall from Remark 1 1 . 6 1 that p -< q implies that 5{p) < 5(q). We will assume 
that either 5{p) > 2 or 5{q) < —2 since otherwise the conclusion of the Theorem 11.81 is obvious 
from Theorem 11.21 Without loss of generality we will assume that S(q) > 5{p) > 2 since the case 
S(p) < 5(q) < —2 can be handled by a symmetry argument. By the formula for v{p) in Lemma 14. II 
it is enough to prove 

5{p) > 2 znd p < q =► Ef[Z Q ]>Ef[Z Q ). (18) 

Note that since 5{q) > 5(p) > 2, the limiting speeds v(p),v(q) > and thus the expectations 
P2°[Z ] and Ef[Z ] are both finite. 

We will use the assumption p -< q to give a coupling of the backward branching processes in 
cookie environments p and q, respectively. Let (H, 3') be the coupled families of Bernoulli random 
variables defined as in the proof of Theorem 1 1.71 Let, Fi k and F- k be the number of failures before 
the k-th success in the sequences of Bernoulli trials {£tj}j>i and id j}j>ii respectively, and let 

Zo = Z' = 0, and Z i+X = Fj+i^+i, Z i+1 = F' i+l ^ +v 

The properties of the coupling (H, S') imply that F^ j. > F' ik for all i 6 Z and fc > 1 and thus also 
that Z, > for all i > 0. 

Now, since Z{ > Z • > and Zj is a positive recurrent Markov chain, it follows that {(Zj, Z-)} is 
a positive recurrent Markov chain. Moreover, it is easy to see that this Markov chain is aperiodic 
and irreducible and therefore (Z n ,Z' n ) converges in distribution as n — > oo. We will denote this 
limiting distribution by PS^. (note that the marginal distributions of P2^. are necessarily P2° and 
P2°). Thus, 

1 n—1 ^ n—1 

lim - ~ Z{) > lim - ]T l {Zi>z , } = P^(Z > Z' ). (19) 

i=0 i=0 

Since P2°, is a stationary distribution we can calculate a lower bound on this probability by 

P^Zq > Z' ) > P^-(Zo = k-l,Z 1 >Z[)> P^(Z = k - l)Pfd F i,k > Kk)- (20) 
In the last inequality we used that if Z' < Zq = k — 1 then Z\ = F\}. and Z[ < F[ k . It follows 
from (|10p in the coupling of S and H' that there exists a k < M such that the last probability in 
(|20p is non-zero. Combining (|19p and (|20p we obtain 

n-l 

< P^Zo > Z ) < lim - ^(Z t - Z;) = PT[Z ] - Pf[Z ], 

i=0 

where the last equality follows from (flTl) and the fact that P2° [Zq] , E^ 1 [Zq] < oo since we assumed 
that 5(p),5(q) > 2. Thus (fTB|) holds, which completes the proof of Theorem 11.81 □ 
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